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Methods and Computer Software Products for Gene Expression Data Quality 

Analysis 
Related Applications 

This application claims the priority of U.S. Provisional Application Serial 
5 Numbers 60/433,136, 60/433,134 and 60/433,228, filed on December 13, 2002, and 
incorporated herein by reference. 

Background of the Invention 
This invention is related to bioinformatics, computer software and computer 
systems. 

10 Massive parallel gene expression monitoring experiments generate unprecedented 

amounts of information. Effective analysis of the large amount of data may lead to the 
development of new drugs and new diagnostic tools. Therefore, there is a great demand 
in the art for methods for organizing, accessing and analyzing the vast amount of 
information collected using massive parallel gene expression monitoring methods. 

15 Summary of the Invention 

In one aspect of the invention, statistical analyses are used to analyze the quality 
metrics of microarray analysis. The methods, systems and computer software products of 
the invention are particularly suitable for microarray based gene expression, genotyping 
and resequencing analysis. 

20 In some embodiments, both discrete and cumulative quality metrics can be 

analyzed: 



2 



EXPRESS MAIL LABEL: EV 187574229 US 
Docket Number: 3567.1 

1) Discrete measures give an indication of the progress of one step in the process. 
For example, Bio B reports the efficiency of the labeling and the hybridization, but does 
not tell us anything about the RNA quality. 

2) Cumulative measures on the other hand report the success of all previous steps 
5 in the process. For example, a percent-present measure in the normal range would 

indicate success of all previous steps in the process: the RNA must have been of good 
quality, the hybridization and labeling must have worked well and the software must have 
been applied properly. These divisions between quality measures are seldom this clear. 
For example background primarily reports the hybridization reaction, but it is often 

10 influenced by sample quality. 

In o ne a spect o f t he i nvention, p rincipal c omponent a nalysis ( PCA) i s u sed t o 
analyze the variability of the quality parameters (metrics) for experimental conditions. 
Principle component analysis (PCA) allows the representation of the effects of all 
parameters in a few vectors. Liner transformation of the quality metrics may be 

15 employed when the quality metrics are not normally distributed. 

In another aspect of the invention, microarray analysis quality is evaluated using 
analysis of variance (ANOVA). In some embodiments, outliers by replication would 
then be counted and summed for each array then the quality metrics for a set of arrays 
would be collected and correlated to the expression outlier sum. Multivariate models can 

20 be tested and the best predictive subset where all independent variables were significant 
and the adjusted r squared maximized can be selected (in a manner similar to PROC REG 
in SAS) Covariance analysis could be used to reduce the number of QC metrics to just 
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those that are independent. The ANOVA model would then provide diagnostic 

information to best discern which quality issue most influenced signal. 

A benefit of and ANOVA model is that it provides information of how well a 
transcript follows the model, in other words the biological effect, but it will also provide 
5 information on data that do not follow the model. Outliers for each probe set were 
derived from residuals from the ANOVA. Residuals are the differences between 
observed values (Signal) and expected values (mean). 

While the methods of the invention are illustrated using gene expression data, the 
methods are also useful for analyzing other types of microarray data, such as genotyping 
10 data and resequencing data. 

Brief Description of the Drawings 
The accompanying drawings, which are incorporated in and form a part of this 
specification, illustrate embodiments of the invention and, together with the description, 
serve to explain the principles of the invention: 
15 Figure 1 shows the experiment design for the example. 

Figure 2 illustrates the quality measures. 

Figure 3 is a graphical view of all quality control parameters: ln(Scaling Factor), 
In(RawQ), ln(Background Average), ln(GAPDH 375' ratio), ln(actin 375' ratio), 
ln(BioB), and Percent Present. 
20 Figure 4 is a matrix plot of the same data used in the PCA model. 

Figure 5 is a matrix plot on linear scales of the same data used in the PCA model. 

Figure 6 shows histograms of RawQ and background. 
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Figure 7 is a PCA, graphical view of all quality control parameters. ln(Scaling 

Factor), ln(RawQ), ln(Background Average), ln(GAPDH 375' ratio), ln(actin 375' ratio), 

ln(BioB), and Percent Present. 0 indicates RawQ < 7, 1 indicates RawQ > 7. The groups 

in the data are associated with the different PMT settings. 

5 Figure 8 shows BioB versus BGAvg (background average). 

Figures 9A and 9B show box plots of rawQ. A. RawQ plotted for all the data. B. 

RawQ with a low PMT setting C. rawQ with a high PMT setting. 

The width of the boxes is relative to the number of arrays. 

Figure 10 shows outliers as a function of RawQ for user 2 Compound J. Y-axis, 

10 number of outlier Signal values at 2 SD for each array. X-axis, number of outliers at 3 

SD. Each data point represents an array. The sizes of the circles are relative to RawQ. 

Figure 1 1 shows the influence of QC measures on QC metrics. The numbers on 

the X-axes indicate the sites. ). lnact = ln(actin 375' ratio), lngapdh = ln(GAPDH 375' 

ratio), rna_iso260280_ratio = RNA 160/280 ratio, ivt_yield = IVT yield. 

15 Figure 12 shows the influence of QC measures on QC metrics. The numbers on 

the X-axes indicate the sites, lnsf = ln(Scaling Factor), lnbiob = ln(BioB), lnbgavg= 

ln(Background Average), lnrawq = ln(RawQ) 

Detailed Description of the Invention 

The present invention has many preferred embodiments and relies on many 

20 patents, applications and other references for details known to those of the art. Therefore, 

when a patent, application, or other reference is cited or repeated below, it should be 

understood that it is incorporated by reference in its entirety for all purposes as well as for 

the proposition that is recited. 
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I. General 

As used in this application, the singular form "a," "an," and "the" include plural 
references unless the context clearly dictates otherwise. For example, the term "an agent" 
includes a plurality of agents, including mixtures thereof 
5 An individual is not limited to a human being but may also be other organisms 

including but not limited to mammals, plants, bacteria, or cells derived from any of the 
above. 

Throughout this disclosure, various aspects of this invention can be presented in a 
range format. It should be understood that the description in range format is merely for 

10 convenience and brevity and should not be construed as an inflexible limitation on the 
scope of the invention. Accordingly, the description of a range should be considered to 
have specifically disclosed all the possible subranges as well as individual numerical 
values within that range. For example, description of a range such as from 1 to 6 should 
be considered to have specifically disclosed subranges such as from 1 to 3, from 1 to 4, 

15 from 1 to 5, from 2 to 4, from 2 to 6, from 3 to 6 etc., as well as individual numbers 

within that range, for example, 1, 2, 3, 4, 5, and 6. This applies regardless of the breadth 
of the range. 

The practice of the present invention may employ, unless otherwise indicated, 
conventional techniques and descriptions of organic chemistry, polymer technology, 
20 molecular biology (including recombinant techniques), cell biology, biochemistry, and 
immunology, which are within the skill of the art. Such conventional techniques include 
polymer array synthesis, hybridization, ligation, and detection of hybridization using a 
label. Specific illustrations of suitable techniques can be had by reference to the example 
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herein below. However, other equivalent conventional procedures can, of course, also be 
used. Such conventional techniques and descriptions can be found in standard laboratory 
manuals such as Genome Analysis: A Laboratory Manual Series (Vols. I-IV), Using 
Antibodies: A Laboratory Manual, Cells: A Laboratory Manual, PCR Primer: A 

5 Laboratory Manual, and Molecular Cloning: A Laboratory Manual (all from Cold Spring 
Harbor Laboratory Press), Stryer, L. (1995) Biochemistry (4th Ed.) Freeman, New York, 
Gait, "Oligonucleotide Synthesis: A Practical Approach" 1984, IRL Press, London, 
Nelson and Cox (2000), Lehninger, Principles of Biochemistry 3rd Ed., W.H. Freeman 
Pub., New York, NY and Berg et al. (2002) Biochemistry, 5th Ed., W.H. Freeman Pub., 

10 New York, NY, all of which are herein incorporated in their entirety by reference for all 
purposes. 

The present invention can employ solid substrates, including arrays in some 
preferred embodiments. Methods and techniques applicable to polymer (including 
protein) array synthesis have been described in U.S.S.N 09/536,841, WO 00/58516, U.S. 

15 Patents Nos. 5,143,854, 5,242,974, 5,252,743, 5,324,633, 5,384,261, 5,405,783, 

5,424,186, 5,451,683, 5,482,867, 5,491,074, 5,527,681, 5,550,215, 5,571,639, 5,578,832, 
5,593,839, 5,599,695, 5,624,711, 5,631,734, 5,795,716, 5,831,070, 5,837,832, 5,856,101, 
5,858,659, 5,936,324, 5,968,740, 5,974,164, 5,981,185, 5,981,956, 6,025,601, 6,033,860, 
6,040,193, 6,090,555, 6,136,269, 6,269,846 and 6,428,752, in PCT Applications Nos. 

20 PCT/US99/00730 (International Publication Number WO 99/36760) and 

PCT/US01/04285, which are all incorporated herein by reference in their entirety for all 
purposes. 
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Patents that describe synthesis techniques in specific embodiments include U.S. 

Patents Nos. 5,412,087, 6,147,205, 6,262,216, 6,310,189, 5,889,165, and 5,959,098. 

Nucleic acid arrays are described in many of the above patents, but the same techniques 

are applied to polypeptide arrays which are also described. 

5 Nucleic acid arrays that are useful in the present invention include those that are 

commercially available from Affymetrix (Santa Clara, CA) under the brand name 
GeneChip®. Example arrays are shown on the website at affymetrix.com. 
The present invention also contemplates many uses for polymers attached to solid 
substrates. These uses include gene expression monitoring, profiling, library screening, 

10 genotyping and diagnostics. Gene expression monitoring, and profiling methods are 
shown in U.S. Patents Nos. 5,800,992, 6,013,449, 6,020,135, 6,033,860, 6,040,138, 
6,177,248 and 6,309,822. Genotyping and uses therefore are shown in USSN 
60/319,253, 10/013,598, and U.S. Patents Nos. 5,856,092, 6,300,063, 5,858,659, 
6,284,460, 6,361,947, 6,368,799 and 6,333,179. Other uses are embodied in U.S. Patents 

15 Nos. 5,871,928, 5,902,723, 6,045,996, 5,541,061, and 6,197,506. 

The present invention also contemplates sample preparation methods in certain 
preferred embodiments. Prior to or concurrent with genotyping, the genomic sample may 
be amplified by a variety of mechanisms, some of which may employ PCR. See, e.g., 
PCR Technology: Principles and Applications for DNA Amplification (Ed. H. A. Erlich, 

20 Freeman Press, NY, NY, 1992); PCR Protocols: A Guide to Methods and Applications 
(Eds. Innis, et al., Academic Press, San Diego, CA, 1990); Mattila et al., Nucleic Acids 
Res. 19, 4967 (1991); Eckert et al., PCR Methods and Applications 1,17 (1991); PCR 
(Eds. McPherson et al., ERL Press, Oxford); and U.S. Patent Nos. 4,683,202, 4,683,195, 
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4,800,159 4,965,1 88,and 5,333,675, and each of which is incorporated herein by 

reference in their entireties for all purposes. The sample may be amplified on the array. 

See, for example, U.S Patent No 6,300,070 and U.S. patent application 09/513,300, 

which are incorporated herein by reference. 
5 Other suitable amplification methods include the ligase chain reaction (LCR) 

(e.g., Wu and Wallace, Genomics 4, 560 (1989), Landegren et al., Science 241, 1077 

(1988) and Barringer et al. Gene 89:1 17 (1990)), transcription amplification (Kwoh et al., 

Proc. Natl. Acad. Sci. USA 86, 1173 (1989) and WO88/10315), self sustained sequence 

replication (Guatelli et al., Proc. Nat. Acad. Sci. USA, 87, 1874 (1990) and 
10 WO90/06995), selective amplification of target polynucleotide sequences (U.S. Patent 

No 6,410,276), consensus sequence primed polymerase chain reaction (CP-PCR) (U.S. 

Patent No 4,437,975), arbitrarily primed polymerase chain reaction (AP-PCR) (U.S. 

Patent No 5,413,909, 5,861,245) and nucleic acid based sequence amplification 

(NABSA). (See, US patents nos. 5,409,818, 5,554,517, and 6,063,603, each of which is 
15 incorporated herein by reference). Other amplification methods that may be used are 

described in, U.S. Patent Nos. 5,242,794, 5,494,810, 4,988,617 and in USSN 09/854,317, 

each of which is incorporated herein by reference. 

Additional methods of sample preparation and techniques for reducing the 

complexity of a nucleic sample are described in Dong et al., Genome Research 11, 1418 
20 (2001), in U.S. Patent No 6,361,947, 6,391,592 and U.S. Patent application Nos. 

09/916,135, 09/920,491, 09/910,292, and 10/013,598, which are incorporated herein by 

reference for all purposes. 
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Methods for conducting polynucleotide hybridization assays have been well 

developed in the art. Hybridization assay procedures and conditions will vary depending 

on the application and are selected in accordance with the general binding methods 

known including those referred to in: Maniatis et al. Molecular Cloning: A Laboratory 

5 Manual (2nd Ed. Cold Spring Harbor, N.Y, 1989); Berger and Kimmel Methods in 

Enzymology, Vol. 152, Guide to Molecular Cloning Techniques (Academic Press, Inc., 

San Diego, CA, 1987); Young and Davism, P.N.A.S, 80: 1194 (1983). Methods and 

apparatus for carrying out repeated and controlled hybridization reactions have been 

described in US patent 5,871,928, 5,874,219, 6,045,996 and 6,386,749, 6,391,623 each of 

10 which are incorporated herein by reference. 

The present invention also contemplates signal detection of hybridization between 
ligands in certain preferred embodiments. See U.S. Pat. Nos. 5,143,854, 5,578,832; 
5,631,734; 5,834,758; 5,936,324; 5,981,956; 6,025,601; 6,141,096; 6,185,030; 6,201,639; 
6,218,803; and 6,225,625, in U.S. Patent application 60/364,731 and in PCT Application 

15 PCT/US99/06097 (published as W099/47964), each of which also is hereby incorporated 
by reference in its entirety for all purposes. 

Methods and apparatus for signal detection and processing of intensity data are 
disclosed in, for example, U.S. Patents Numbers 5,143,854, 5,547,839, 5,578,832, 
5,631,734, 5,800,992, 5,834,758; 5,856,092, 5,902,723, 5,936,324, 5,981,956, 6,025,601, 

20 6,090,555, 6,141,096, 6,185,030, 6,201,639; 6,218,803; and 6,225,625, in U.S. Patent 
application 60/364,731 and in PCT Application PCT/US99/06097 (published as 
W099/47964), each of which also is hereby incorporated by reference in its entirety for 
all purposes. 
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The practice of the present invention may also employ conventional biology 

methods, software and systems. Computer software products of the invention typically 

include computer readable medium having computer-executable instructions for 

performing the logic steps of the method of the invention. Suitable computer readable 

5 medium include floppy disk, CD-ROM/DVD/DVD-ROM, hard-disk drive, flash 

memory, ROM/RAM, magnetic tapes and etc. The computer executable instructions may 

be written in a suitable computer language or combination of several languages. Basic 

computational biology methods are described in, e.g. Setubal and Meidanis et al., 

Introduction to Computational Biology Methods (PWS Publishing Company, Boston, 

10 1997); Salzberg, Searles, Kasif, (Ed.), Computational Methods in Molecular Biology, 

(Elsevier, Amsterdam, 1998); Rashidi and Buehler, Bioinformatics Basics: Application in 

Biological Science and Medicine (CRC Press, London, 2000) and Ouelette and Bzevanis 

Bioinformatics: A Practical Guide for Analysis of Gene and Proteins (Wiley & Sons, 

Inc., 2nd ed.,2001). 

15 The present invention may also make use of various computer program products 

and software for a variety of purposes, such as probe design, management of data, 
analysis, and instrument operation. See, U.S. Patent Nos. 5,593,839, 5,795,716, 
5,733,729, 5,974,164, 6,066,454, 6,090,555, 6,185,561, 6,188,783, 6,223,127, 6,229,911 
and 6,308,170, which are incorporated herein by reference. 

20 Additionally, the present invention may have preferred embodiments that include 

methods for providing genetic information over networks such as the Internet as shown in 
U.S. Patent applications 10/063,559, 60/349,546, 60/376,003, 60/394,574, 60/403,381. 
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II. Glossary 

The following terms are intended to have the following general meanings as used 
herein. 

Nucleic acids according to the present invention may include any polymer or 
5 oligomer of pyrimidine and purine bases, preferably cytosine (C) , thymine (T), and 
uracil (U), and adenine (A) and guanine (G), respectively. See Albert L. Lehninger, 
PRINCIPLES OF BIOCHEMISTRY, at 793-800 (Worth Pub. 1982). Indeed, the present 
invention contemplates any deoxyribonucleotide, ribonucleotide or peptide nucleic acid 
component, and any chemical variants thereof, such as methylated, hydroxymethylated or 
10 glucosylated forms of these bases, and the like. The polymers or oligomers may be 
heterogeneous or homogeneous in composition, and may be isolated from naturally 
occurring sources or may be artificially or synthetically produced. In addition, the 
nucleic acids may be deoxyribonucleic acid (DNA) or ribonucleic acid (RNA), or a 
mixture thereof, and may exist permanently or transitionally in single-stranded or double- 
ts stranded form, including homoduplex, heteroduplex, and hybrid states. 

An "oligonucleotide" or "polynucleotide" is a nucleic acid ranging from at least 2, 
preferable at least 8, and more preferably at least 20 nucleotides in length or a compound 
that specifically hybridizes to a polynucleotide. Polynucleotides of the present invention 
include sequences of deoxyribonucleic acid (DNA) or ribonucleic acid (RNA), which 
20 may be isolated from natural sources, recombinantly produced or artificially synthesized 
and mimetics thereof. A further example of a polynucleotide of the present invention 
may be peptide nucleic acid (PNA) in which the constituent bases are joined by peptides 
bonds rather than phosphodiester linkage, as described in Nielsen et al., Science 
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254:1497-1500 (1991), Nielsen Curr. Opin. Biotechnol., 10:71-75 (1999). The invention 
also encompasses situations in which there is a nontraditional base pairing such as 
Hoogsteen base pairing which has been identified in certain tRNA molecules and 
postulated to exist in a triple helix. "Polynucleotide" and "oligonucleotide" are used 
interchangeably in this application. 

An "array" is an intentionally created collection of molecules which can be 
prepared either synthetically or biosynthetically. The molecules in the array can be 
identical or different from each other. The array can assume a variety of formats, e.g., 
libraries of soluble molecules; libraries of compounds tethered to resin beads, silica chips, 
or other solid supports. 

A nucleic acid library or array is an intentionally created collection of nucleic 
acids which can be prepared either synthetically or biosynthetically in a variety of 
different formats (e.g., libraries of soluble molecules; and libraries of oligonucleotides 
tethered to resin beads, silica chips, or other solid supports). Additionally, the term 
"array" is meant to include those libraries of nucleic acids which can be prepared by 
spotting nucleic acids of essentially any length (e.g., from 1 to about 1000 nucleotide 
monomers in length) onto a substrate. The term "nucleic acid" as used herein refers to a 
polymeric form of nucleotides of any length, either ribonucleotides, deoxyribonucleotides 
or peptide nucleic acids (PNAs), that comprise purine and pyrimidine bases, or other 
natural, chemically or biochemically modified, non-natural, or derivatized nucleotide 
bases (see, e.g., U.S. Patent No. 6,156, 501, incorporated herein by reference). The 
backbone of the polynucleotide can comprise sugars and phosphate groups, as may 
typically be found in RNA or DNA, or modified or substituted sugar or phosphate 
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groups. A polynucleotide may comprise modified nucleotides, such as methylated 
nucleotides and nucleotide analogs. The sequence of nucleotides may be interrupted by 
non-nucleotide components. Thus the terms nucleoside, nucleotide, deoxynucleoside and 
deoxynucleotide generally include analogs such as those described herein. These analogs 
are those molecules having some structural features in common with a naturally 
occurring nucleoside or nucleotide such that when incorporated into a nucleic acid or 
oligonucleotide sequence, they allow hybridization with a naturally occurring nucleic 
acid sequence in solution. Typically, these analogs are derived from naturally occurring 
nucleosides and nucleotides by replacing and/or modifying the base, the ribose or the 
phosphodiester moiety. The changes can be tailor made to stabilize or destabilize hybrid 
formation or enhance the specificity of hybridization with a complementary nucleic acid 
sequence as desired. 

"Solid support", "support", and "substrate" are used interchangeably and refer to a 
material or group of materials having a rigid or semi-rigid surface or surfaces. In many 
embodiments, at least one surface of the solid support will be substantially flat, although 
in some embodiments it may be desirable to physically separate synthesis regions for 
different compounds with, for example, wells, raised regions, pins, etched trenches, or the 
like. According to other embodiments, the solid support(s) will take the form of beads, 
resins, gels, microspheres, or other geometric configurations. 

Combinatorial Synthesis Strategy: A combinatorial synthesis strategy is an 
ordered strategy for parallel synthesis of diverse polymer sequences by sequential 
addition of reagents which may be represented by a reactant matrix and a switch matrix, 
the product of which is a product matrix. A reactant matrix is a 1 column by m row 
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matrix of the building blocks to be added. The switch matrix is all or a subset of the 
binary numbers, preferably ordered, between 1 and m arranged in columns. A "binary 
strategy" is one in which at least two successive steps illuminate a portion, often half, of a 
region of interest on the substrate. In a binary synthesis strategy, all possible compounds 
5 which can be formed from an ordered set of reactants are formed. In most preferred 

embodiments, binary synthesis refers to a synthesis strategy which also factors a previous 
addition step. For example, a strategy in which a switch matrix for a masking strategy 
halves regions that were previously illuminated, illuminating about half of the previously 
illuminated region and protecting the remaining half (while also protecting about half of 

10 previously protected regions and illuminating about half of previously protected regions). 
It will be recognized that binary rounds may be interspersed with non-binary rounds and 
that only a portion of a substrate may be subjected to a binary scheme. A combinatorial 
"masking" strategy is a synthesis which uses light or other spatially selective deprotecting 
or activating agents to remove protecting groups from materials for addition of other 

15 materials such as amino acids. See, e.g., U.S. Patent No. 5,143,854. 

Monomer: refers to any member of the set of molecules that can be joined 
together to form an oligomer or polymer. The set of monomers useful in the present 
invention includes, but is not restricted to, for the example of (polypeptide synthesis, the 
set of L-amino acids, D-amino acids, or synthetic amino acids. As used herein, 

20 "monomer" refers to any member of a basis set for synthesis of an oligomer. For 

example, dimers of L-amino acids form a basis set of 400 "monomers" for synthesis of 
polypeptides. Different basis sets of monomers may be used at successive steps in the 
synthesis of a polymer. The term "monomer" also refers to a chemical subunit that can be 



15 



EXPRESS MAIL LABEL: EV 187574229 US 
Docket Number: 3567.1 

combined with a different chemical subunit to form a compound larger than either 
subunit alone. 

Biopolymer or biological polymer: is intended to mean repeating units of 
biological or chemical moieties. Representative biopolymers include, but are not limited 
to, nucleic acids, oligonucleotides, amino acids, proteins, peptides, hormones, 
oligosaccharides, lipids, glycolipids, lipopolysaccharides, phospholipids, synthetic 
analogues of the foregoing, including, but not limited to, inverted nucleotides, peptide 
nucleic acids, Meta-DNA, and combinations of the above. "Biopolymer synthesis" is 
intended to encompass the synthetic production, both organic and inorganic, of a 
biopolymer. 

Related to a bioploymer is a "biomonomer" which is intended to mean a single 
unit of biopolymer, or a single unit which is not part of a biopolymer. Thus, for example, 
a nucleotide is a biomonomer within an oligonucleotide biopolymer, and an amino acid is 
a biomonomer within a protein or peptide biopolymer; avidin, biotin, antibodies, antibody 
fragments, etc., for example, are also biomonomers. Initiation Biomonomer: or "initiator 
biomonomer" is meant to indicate the first biomonomer which is covalently attached via 
reactive nucleophiles to the surface of the polymer, or the first biomonomer which is 
attached to a linker or spacer arm attached to the polymer, the linker or spacer arm being 
attached to the polymer via reactive nucleophiles. 

Complementary: Refers to the hybridization or base pairing between nucleotides 
or nucleic acids, such as, for instance, between the two strands of a double stranded DNA 
molecule or between an oligonucleotide primer and a primer binding site on a single 
stranded nucleic acid to be sequenced or amplified. Complementary nucleotides are, 
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generally, A and T (or A and U), or C and G. Two single stranded RNA or DNA 
molecules are said to be complementary when the nucleotides of one strand, optimally 
aligned and compared and with appropriate nucleotide insertions or deletions, pair with at 
least about 80% of the nucleotides of the other strand, usually at least about 90% to 95%, 
5 and more preferably from about 98 to 100%. Alternatively, complementarity exists when 
an RNA or DNA strand will hybridize under selective hybridization conditions to its 
complement. Typically, selective hybridization will occur when there is at least about 
65% complementary over a stretch of at least 14 to 25 nucleotides, preferably at least 
about 75%, more preferably at least about 90% complementary. See, M. Kanehisa 

10 Nucleic Acids Res. 12:203 (1984), incorporated herein by reference. 

The term "hybridization" refers to the process in which two single-stranded 
polynucleotides bind non-covalently to form a stable double-stranded polynucleotide. 
The term "hybridization" may also refer to triple-stranded hybridization. The resulting 
(usually) double-stranded polynucleotide is a "hybrid." The proportion of the population 

15 of polynucleotides that forms stable hybrids is referred to herein as the "degree of 
hybridization". 

Hybridization conditions will typically include salt concentrations of less than 
about 1M, more usually less than about 500 mM and less than about 200 mM. 
Hybridization temperatures can be as low as 5°C, but are typically greater than 22°C, 
20 more typically greater than about 30°C, and preferably in excess of about 37°C. 

Hybridizations are usually performed under stringent conditions, i.e. conditions under 
which a probe will hybridize to its target subsequence. Stringent conditions are 
sequence-dependent and are different in different circumstances. Longer fragments may 
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require higher hybridization temperatures for specific hybridization. As other factors may 
affect the stringency of hybridization, including base composition and length of the 
complementary strands, presence of organic solvents and extent of base mismatching, the 
combination of parameters is more important than the absolute measure of any one alone. 
Generally, stringent conditions are selected to be about 5°C lower than the thermal 
melting point (Tm) fro the specific sequence at a defined ionic strength and pH. The Tm 
is the temperature (under defined ionic strength, pH and nucleic acid composition) at 
which 50% of the probes complementary to the target sequence hybridize to the target 
sequence at equilibrium. 

Typically, stringent conditions include salt concentration of at least 0.01 M to no 
more than 1 M Na ion concentration (or other salts) at a pH 7.0 to 8.3 and a temperature 
of at least 25°C. For example, conditions of 5X SSPE (750 mM NaCl, 50 mM 
NaPhosphate, 5 mM EDTA, pH 7.4) and a temperature of 25-30°C are suitable for allele- 
specific probe hybridizations. For stringent conditions, see for example, Sambrook, 
Fritsche and Maniatis. "Molecular Cloning A laboratory Manual" 2nd Ed. Cold Spring 
Harbor Press (1989) and Anderson "Nucleic Acid Hybridization" 1st Ed., BIOS 
Scientific Publishers Limited (1999), which are hereby incorporated by reference in its 
entirety for all purposes above. 

Hybridization probes are nucleic acids (such as oligonucleotides) capable of 
binding in a base-specific manner to a complementary strand of nucleic acid. Such 
probes include peptide nucleic acids, as described in Nielsen et al., Science 254:1497- 
1500 (1991), Nielsen Curr. Opin. Biotechnol, 10:71-75 (1999) and other nucleic acid 
analogs and nucleic acid mimetics. See US Patent No. 6,156,501. 
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Probe: A probe is a molecule that can be recognized by a particular target. In 
some embodiments, a probe can be surface immobilized. Examples of probes that can be 
investigated by this invention include, but are not restricted to, agonists and antagonists 
for cell membrane receptors, toxins and venoms, viral epitopes, hormones (e.g., opioid 

5 peptides, steroids, etc.), hormone receptors, peptides, enzymes, enzyme substrates, 
cofactors, drugs, lectins, sugars, oligonucleotides, nucleic acids, oligosaccharides, 
proteins, and monoclonal antibodies. 

Target: A molecule that has an affinity for a given probe. Targets may be 
naturally-occurring or man-made molecules. Also, they can be employed in their 

10 unaltered state or as aggregates with other species. Targets may be attached, covalently or 
noncovalently, to a binding member, either directly or via a specific binding substance. 
Examples of targets which can be employed by this invention include, but are not 
restricted to, antibodies, cell membrane receptors, monoclonal antibodies and antisera 
reactive with specific antigenic determinants (such as on viruses, cells or other materials), 

15 drugs, oligonucleotides, nucleic acids, peptides, cofactors, lectins, sugars, 

polysaccharides, cells, cellular membranes, and organelles. Targets are sometimes 
referred to in the art as anti-probes. As the term targets is used herein, no difference in 
meaning is intended. A "Probe Target Pair" is formed when two macromolecules have 
combined through molecular recognition to form a complex. 

20 Ligand: A ligand is a molecule that is recognized by a particular receptor. The 

agent bound by or reacting with a receptor is called a "ligand," a term which is 
defmitionally meaningful only in terms of its counterpart receptor. The term "ligand" 
does not imply any particular molecular size or other structural or compositional feature 
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other than that the substance in question is capable of binding or otherwise interacting 
with the receptor. Also, a ligand may serve either as the natural ligand to which the 
receptor binds, or as a functional analogue that may act as an agonist or antagonist. 
Examples of ligands that can be investigated by this invention include, but are not 
restricted to, agonists and antagonists for cell membrane receptors, toxins and venoms, 
viral epitopes, hormones (e.g., opiates, steroids, etc.), hormone receptors, peptides, 
enzymes, enzyme substrates, substrate analogs, transition state analogs, cofactors, drugs, 
proteins, and antibodies. 

Receptor: A molecule that has an affinity for a given ligand. Receptors may be 
naturally-occurring or manmade molecules. Also, they can be employed in their unaltered 
state or as aggregates with other species. Receptors may be attached, covalently or 
noncovalently, to a binding member, either directly or via a specific binding substance. 
Examples of receptors which can be employed by this invention include, but are not 
restricted to, antibodies, cell membrane receptors, monoclonal antibodies and antisera 
reactive with specific antigenic determinants (such as on viruses, cells or other materials), 
drugs, polynucleotides, nucleic acids, peptides, cofactors, lectins, sugars, 
polysaccharides, cells, cellular membranes, and organelles. Receptors are sometimes 
referred to in the art as anti-ligands. As the term receptors is used herein, no difference in 
meaning is intended. A "Ligand Receptor Pair" is formed when two macromolecules 
have combined through molecular recognition to form a complex. Other examples of 
receptors which can be investigated by this invention include but are not restricted to 
those molecules shown in U.S. Patent No. 5,143,854, which is hereby incorporated by 
reference in its entirety. 
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Effective amount refers to an amount sufficient to induce a desired result. 

mRNA or mRNA transcripts: as used herein, include, but not limited to pre- 

mRNA transcript(s), transcript processing intermediates, mature mRNA(s) ready for 

translation and transcripts of the gene or genes, or nucleic acids derived from the mRNA 

5 transcript(s). Transcript processing may include splicing, editing and degradation. As 

used herein, a nucleic acid derived from an mRNA transcript refers to a nucleic acid for 

whose synthesis the mRNA transcript or a subsequence thereof has ultimately served as a 

template. Thus, a cDNA reverse transcribed from an mRNA, a cRNA transcribed from 

that cDNA, a DNA amplified from the cDNA, an RNA transcribed from the amplified 

10 DNA, etc., are all derived from the mRNA transcript and detection of such derived 
products is indicative of the presence and/or abundance of the original transcript in a 
sample. Thus, mRNA derived samples include, but are not limited to, mRNA transcripts 
of the gene or genes, cDNA reverse transcribed from the mRNA, cRNA transcribed from 
the cDNA, DNA amplified from the genes, RNA transcribed from amplified DNA, and 

15 the like. 

A fragment, segment, or DNA segment refers to a portion of a larger DNA 
polynucleotide or DNA. A polynucleotide, for example, can be broken up, or fragmented 
into, a plurality of segments. Various methods of fragmenting nucleic acid are well 
known in the art. These methods may be, for example, either chemical or physical in 
20 nature. Chemical fragmentation may include partial degradation with a DNase; partial 
depurination with acid; the use of restriction enzymes; intron-encoded endonucleases; 
DNA-based cleavage methods, such as triplex and hybrid formation methods, that rely on 
the specific hybridization of a nucleic acid segment to localize a cleavage agent to a 
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specific location in the nucleic acid molecule; or other enzymes or compounds which 
cleave DNA at known or unknown locations. Physical fragmentation methods may 
involve subjecting the DNA to a high shear rate. High shear rates may be produced, for 
example, by moving DNA through a chamber or channel with pits or spikes, or forcing 
5 the DNA sample through a restricted size flow passage, e.g., an aperture having a cross 
sectional dimension in the micron or submicron scale. Other physical methods include 
sonication and nebulization. Combinations of physical and chemical fragmentation 
methods may likewise be employed such as fragmentation by heat and ion-mediated 
hydrolysis. See for example, Sambrook et al., "Molecular Cloning: A Laboratory 

10 Manual," 3rd Ed. Cold Spring Harbor Laboratory Press, Cold Spring Harbor, New York 
(2001) ("Sambrook et al.) which is incorporated herein by reference for all purposes. 
These methods can be optimized to digest a nucleic acid into fragments of a selected size 
range. Useful size ranges may be from 100, 200, 400, 700 or 1000 to 500, 800, 1500, 
2000, 4000 or 10,000 base pairs. However, larger size ranges such as 4000, 10,000 or 

15 20,000 to 10,000, 20,000 or 500,000 base pairs may also be useful. See, e.g., Dong et al., 
Genome Research 11, 1418 (2001), in U.S. Patent No 6,361,947, 6,391,592, incorporated 
herein by reference. 

A primer is a single-stranded oligonucleotide capable of acting as a point of 
initiation for template-directed DNA synthesis under suitable conditions e.g., buffer and 

20 temperature, in the presence of four different nucleoside triphosphates and an agent for 
polymerization, such as, for example, DNA or RNA polymerase or reverse transcriptase. 
The length of the primer, in any given case, depends on, for example, the intended use of 
the primer, and generally ranges from 15 to 30 nucleotides. Short primer molecules 
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generally require cooler temperatures to form sufficiently stable hybrid complexes with 
the template. A primer need not reflect the exact sequence of the template but must be 
sufficiently complementary to hybridize with such template. The primer site is the area 
of the template to which a primer hybridizes. The primer pair is a set of primers 

5 including a 5' upstream primer that hybridizes with the 5* end of the sequence to be 
amplified and a 3' downstream primer that hybridizes with the complement of the 3 1 end 
of the sequence to be amplified. 

A genome is all the genetic material of an organism. In some instances, the term 
genome may refer to the chromosomal DNA. Genome may be multichromosomal such 

10 that the DNA is cellularly distributed among a plurality of individual chromosomes. For 
example, in human there are 22 pairs of chromosomes plus a gender associated XX or 
XY pair. DNA derived from the genetic material in the chromosomes of a particular 
organism is genomic DNA. The term genome may also refer to genetic materials from 
organisms that do not have chromosomal structure. In addition, the term genome may 

15 refer to mitochondria DNA. A genomic library is a collection of DNA fragments 
represents the whole or a portion of a genome. Frequently, a genomic libarry is a 
collection of clones made from a set of randomly generated, sometimes overlapping 
DNA fragments representing the entire genome or a portion of the genome of an 
organism. 

20 An allele refers to one specific form of a genetic sequence (such as a gene) within 

a cell or within a population, the specific form differing from other forms of the same 
gene in the sequence of at least one, and frequently more than one, variant sites within the 
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sequence of the gene. The sequences at these variant sites that differ between different 
alleles are termed "variances", "polymorphisms", or "mutations". 

At each autosomal specific chromosomal location or "locus" an individual possesses two 
alleles, one inherited from the father and one from the mother. An individual is 

5 "heterozygous" at a locus if it has two different alleles at that locus. An individual is 
"homozygous" at a locus if it has two identical alleles at that locus. 

Polymorphism refers to the occurrence of two or more genetically determined 
alternative sequences or alleles in a population. A polymorphic marker or site is the 
locus at which divergence occurs. Preferred markers have at least two alleles, each 

10 occurring at frequency of greater than 1%, and more preferably greater than 10% or 20% 
of a selected population. A polymorphism may comprise one or more base changes, an 
insertion, a repeat, or a deletion. A polymorphic locus may be as small as one base pair. 
Polymorphic markers include restriction fragment length polymorphisms, variable 
number of tandem repeats (VNTR's), hypervariable regions, minisatellites, dinucleotide 

15 repeats, trinucleotide repeats, tetranucleotide repeats, simple sequence repeats, and 

insertion elements such as Alu. The first identified allelic form is arbitrarily designated 
as the reference form and other allelic forms are designated as alternative or variant 
alleles. The allelic form occurring most frequently in a selected population is sometimes 
referred to as the wildtype form. Diploid organisms may be homozygous or 

20 heterozygous for allelic forms. A diallelic polymorphism has two forms. A triallelic 

polymorphism has three forms. Single nucleotide polymorphisms (SNPs) are included in 
polymorphisms. 
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Single nucleotide polymorphism (SNPs) are positions at which two alternative 
bases occur at appreciable frequency (>1%) in the human population, and are the most 
common type of human genetic variation. The site is usually preceded by and followed 
by highly conserved sequences of the allele (e.g., sequences that vary in less than 1/100 
5 or 1/1000 members of the populations). A single nucleotide polymorphism usually arises 
due to substitution of one nucleotide for another at the polymorphic site. A transition is 
the replacement of one purine by another purine or one pyrimidine by another 
pyrimidine. A transversion is the replacement of a purine by a pyrimidine or vice versa. 
Single nucleotide polymorphisms can also arise from a deletion of a nucleotide or an 

10 insertion of a nucleotide relative to a reference allele. 

Genotyping refers to the determination of the genetic information an individual 
carries at one or more positions in the genome. For example, genotyping may comprise 
the determination of which allele or alleles an individual carries for a single SNP or the 
determination of which allele or alleles an individual carries for a plurality of SNPs. A 

15 genotype may be the identity of the alleles present in an individual at one or more 
polymorphic sites. 

Linkage disequilibrium or allelic association means the preferential association of 
a particular allele or genetic marker with a specific allele, or genetic marker at a nearby 
chromosomal location more frequently than expected by chance for any particular allele 
20 frequency in the population. For example, if locus X has alleles a and b, which occur 
equally frequently, and linked locus Y has alleles c and d, which occur equally 
frequently, one would expect the combination ac to occur with a frequency of 0.25. If ac 
occurs more frequently, then alleles a and c are in linkage disequilibrium. Linkage 
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disequilibrium may result from natural selection of certain combination of alleles or 
because an allele has been introduced into a population too recently to have reached 
equilibrium with linked alleles. A marker in linkage disequilibrium can be particularly 
useful in detecting susceptibility to disease (or other phenotype) notwithstanding that the 
5 marker does not cause the disease. For example, a marker (X) that is not itself a causative 
element of a disease, but which is in linkage disequilibrium with a gene (including 
regulatory sequences) (Y) that is a causative element of a phenotype, can be detected to 
indicate susceptibility to the disease in circumstances in which the gene Y may not have 
been identified or may not be readily detectable. 

10 A software product typically includes a computer readable medium, such as CD- 

ROM or a DVD Rom disk. Software codes that execute the method steps of the 
invention are stored in the computer readable medium. Software of the invention can be 
written in any suitable language including C/C++, Java, C#. Basic, Fortran, Perl, etc. 
In yet another aspect of the invention, systems for analyzing biological data are provided. 

15 In some embodiments, the system include a central processing unit (CPU) and coupled 
with the CPU is a memory unit. The system executes the methods steps of the invention. 

III. Gene Expression Data Quality Analysis 

Gene expression monitoring using microarrays is a process that involves several 
20 assay steps. For large scale experiments, the assays and analyses may be performed at 
multiple sites by different operators. Therefore, it is important to analyze the data quality 
for such large scale experiments. 
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One of skill in the art would appreciate that there are many suitable quality 
measurements that can be used to monitor the quality of gene expression data. For 
illustration purpose, the following metrics are provided as exemplary gene expression 
monitoring quality indicators: 
5 1) Discrete measures give an indication of the progress of one step in the process. 

For example, Bio B reports the efficiency of the labeling and the hybridization, but does 
not tell us anything about the RNA quality. 

2) Cumulative measures on the other hand report the success of all previous steps 
in the process. For example, a percent-present measure in the normal range would 

10 indicate success of all previous steps in the process: the RNA must have been of good 
quality, the hybridization and labeling must have worked well and the software must have 
been applied properly. These divisions between quality measures are seldom this clear. 
For example background primarily reports the hybridization reaction, but it is often 
influenced by sample quality. 

15 In o ne a spect o f t he i nvention, p rincipal c omponent a nalysis ( PC A) i s u sed t o 

analyze the variability of the quality parameters (metrics) for experimental conditions. 
Principle component analysis (PCA) allows the representation of the effects of all 
parameters in a few vectors. Ideally PCA will break the data out into smaller groups and 
provide insight into the causes of variability. A PCA applies a linear model to the data, 

20 so all non-normally distributed QC parameters can be log transformed to improve 
linearity. Log transformation more evenly disperses the data across the recorded range of 
most metrics. This results in a more linear pattern and improves the efficacy of PCA. 
Principal component analysis is well known in the art and is described in, for example, 
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"Principal Components Analysis" by George H. Dunteman, Sage Publications; (July 
1989) ISBN: 0803931042. 

In another aspect of the invention, methods and software products are provided to 
discern the causes of variability in expression data quality control metrics produced by 
monitoring software and collected by the lab can be correlated to outliers determined by 
the application of models and the examination of residuals. 

In some embodiments, outliers by replication would then be counted and summed 
for each array then the quality metrics for a set of arrays would be collected and 
correlated to the expression outlier sum. Multivariate models can be tested and the best 
predictive subset where all independent variables were significant and the adjusted r 
squared maximized can be selected (in a manner similar to PROC REG in SAS) 
Covariance analysis could be used to reduce the number of QC metrics to just those that 
are independent. The ANOVA model would then provide diagnostic information to best 
discern which quality issue most influenced signal. 

A benefit of and ANOVA model is that it provides information of how well a 
transcript follows the model, in other words the biological effect, but it will also provide 
information on data that do not follow the model. Outliers for each probe set were 
derived from residuals from the ANOVA. Residuals are the differences between 
observed values (Signal) and expected values (mean). 

While the methods of the invention are illustrated using gene expression data, the 
methods are also useful for analyzing other types of microarray data, such as genotyping 
data and resequencing data. 
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The computer software product of the invention may be executed in a single 
computer or over a network, such as a local area network or a wide area network (e.g., 
the internet). In a particularly preferred embodiment, the software is executed in an 
application server for a web server. A user can remotely conduct all the analysis. 
5 A software product typically includes a computer readable medium, such as CD- 

ROM or a DVD Rom disk. Software codes that execute the method steps of the 
invention are stored in the computer readable medium. Software of the invention can be 
written in any suitable language including C/C++, Java, C#. Basic, Fortran, Perl, etc. 
In yet another aspect of the invention, systems for analyzing biological data are provided. 
10 In some embodiments, the system includes a central processing unit (CPU) and coupled 
with the CPU is a memory unit. The system executes the methods steps of the invention. 

IV. Example 

This experiment conducted in multiple sites illustrates various microarray data 
15 quality analysis and control methods. The overall experimental design is shown in Figure 
1. In all, 17 compounds were studied. The RNA from each animal was prepared and 
distributed to different sites. Not all aliquots were sent to all sites and some samples were 
pooled. 

Primary analysis 

20 1) All .DAT images were processed with MAS5.0. 

2) All .CHP files were scaled to a target intensity of 500 using MAS5.0 

3) All Signal values were exported from MAS as tab delimited files and imported 
into STATA 7.0/SE (College Station, TX) 
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4) All Signal values were log transformed using natural log. A small arbitrary 
constant, 50 was added to the transformed values to create a new value called 

LOGSIG_PLUS: 

Logsig_plus = ln(Signal + 50) 

5 Log transformed signal values more closely approximate a normal distribution 

which allows any multiplicative error to be handled arithmetically and improves the 
efficacy of parametric methods. If the assumptions about the distribution of error are 
valid, parametric methods are more powerful than nonparametric methods. An increase in 
power is particularly beneficial in this experimental design where the number of 

10 replicates is limited relative to the number of experimental variables. 

The small constant was added to minimize variance inflation caused by log 
transformation. 

Unifying the data 

Additional quality control (QC) and other data were provided: 
File information 
.dat file name 

Pooled or individual animal sample? 

Which Working Group? 

What compound? 

What dose? " 

What day of treatment? 

What replicate? " 
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Sample QC 



Sample type (cell/tissue type; fresh or frozen) 



Starting RNA type (total or polyA+) 



RNA isolation method (Trizol, kits, other) 



Starting RNA amt. (micrograms) 



rRNA integrity (subjective: acceptable or poor) 



260/280 ratio (upon isolation) 



Operator (Operator's initials) 



Other/Comments 
RNA Processing QC 



260/280 rado (upon processing) 


it 
ill 




■!.': r 




V kit used , 

I - : ' : 


: 


yymm 






IVT (in vitro transcription kit used (ENZO, other) 


IVT yield (micrograms cRN A) 


Opm 


itor (Operator's initials) 








Other/Comments 


trs> •;?' ' ' ^ . . l' : r J m%: 



Hybridization/washing QC 



Hybridization Temperature 

Hybridization Time 

Fluidics Station errors? 

S APE (streptavidin phycoerythrin) (source or 

vendor?) 



Antibody amplification done? (yes or no) 
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Operator (Operator's initials) 



Other/Comments 













Array/DAT file QC 



Overall Quality (subjective: good or bad) 


Si 


:anner PMT setting (high or low) 






Artifacts (scratches, particles, etc.) 


Sft 


; ; 


Operator (Operator's initials) 




1 ' : . i 


|@ther/Gomrrterits • l^M : . ' ' : M 



A significant part of the data analysis effort involved cleaning, encoding and 
joining the data. 

Quality COntrol 

5 There are a number of quality parameters that are used to judge the progress of the 
experiment. The quality measures can be divided into two broad categories: 

1) Discrete measures give an indication of the progress of one step in the 
process. For example, Bio B reports the efficiency of the labeling and the 
hybridization, but does not tell us anything about the RNA quality. 

10 2) Cumulative measures on the other hand report the success of all previous 
steps i n t he p rocess. For e xample, a p ercent-present m easure i n t he n ormal 
range would indicate success of a 11 previous steps in the process: the RNA 
must have been of good quality, the hybridization and labeling must have 
worked well and the software must have been applied properly. These 
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divisions between quality measures are seldom this clear. For example 

background primarily reports the hybridization reaction, but it is often 

influenced by sample quality. 



Table 1. Key Quality Control Statistics 



variable 


observations 


mean 


Std 


min 


max 


CV 


Median 


260/280 ratio (upon 
isolation) 


396 


1.915369 


0.214945 


1.408 


3.89 


0.112221 


1.93 


260/280 ratio (upon 
processing) 


404 


1.991726 


0.233992 


1.1 


2.587 


0.117482 


2.026 


Scale factor 


652 


4.076933 


3.733433 


0.182 


32.582 


0.915746 


3.35 


rawQ 


652 


9.842331 


9.1225 


1.21 


79.53 


0.926864 


3.085 


background average 


652 


304.5123 


291.9048 


0.5 


1967.74 


0.958598 


94.635 


percent present 


652 


36.11012 


6.210127 


8.2 


56.7 


0.171978 


36.3 


actin 3' 5'ratio 


652 


1.777101 


2.687701 


0.68 


58.3 


1.512408 


1.23 


GAPDH 3' 5' ratio 


652 


1.259862 


0.944871 


0.71 


12.47 


0.74998 


1.01 


bioB 


652 


1567.726 


3510.689 


1 


25759.1 


2.239351 


580.5 


IVT yield 

(micrograms cRNA) 


545 


63.70235 


20.51557 


6.8 


125.35 


0.322054 


64.34 



5 



Principle component analysis 

Our first look at data quality is to examine the variability of the quality parameters 
for all the compounds on all the arrays. Principle component analysis (PCA) allows the 
representation of the effects of all parameters in a few vectors. Ideally PCA will break 
10 the data out into smaller groups and provide insight into the causes of variability. A PCA 
applies a linear model to the data, so all non-normally distributed QC parameters were 
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log transformed to improve linearity. Log transformation more evenly disperses the data 
across the recorded range of most metrics. This results in a more linear pattern and 
improves the efficacy of PCA. 

Table 2. PCA table (67% of the variance in this dataset can be explained by two 
components.) 



(principal components; 7 components retained) 



Component 


Eigenvalue 


Difference 


Proportion 


Cumulative 








1 


2.85789 


0.95679 


0.4083 


0.4083 








2 


1.90111 


0.64206 


0.2716 


0.6799 








3 


1.25904 


0.7116 


0.1799 


0.8597 








4 


0.54744 


0.23435 


0.0782 


0.9379 








5 


0.31309 


0.23701 


0.0447 


0.9827 








6 


0.07608 


0.03073 


0.0109 


0.9935 








7 


0.04535 




0.0065 


1 








Eigenvectors 
















Variable 


1 


2 


3 


4 


5 


6 


7 


Insf 


-0.53167 


0.14737 


-0.20674 


-0.3128 


0.14071 


0.65049 


0.33479 


Inrawq 


0.56347 


0.0446 


-0.21648 


0.01608 


-O.06058 


-0.00594 


0.79353 


Inbgavg 


0.55586 


0.02658 


-0.19603 


0.14295 


0.24031 


0.62385 


-0.42956 


Ingapdh 


0.16081 


0.5059 


0.48139 


-0.20003 


-0.62297 


0.2357 


-0.05305 


Inactin 


0.03742 


0.5985 


0.35948 


0.04885 


0.68908 


-0.16174 


0.08826 


Inbiob 


-0.23727 


0.42739 


-0.35114 


0.76464 


-0.22973 


0.00695 


0.01569 


percentprent 


-0.08537 


-0.42283 


0.62266 


0.50437 


0.05556 


0.32539 


0.25071 



In indicates natural logs. Sf = scaling factor, rawq = rawQ, 



bgavg = background average, gapdh = GAPDH 375' ratio, 
actin = actin 375' ratio, biob = BioB, percentpresent = 
percent present. 



This overall view of the data (Figure 3) clearly shows that it is derived from two 
populations. This model includes different arrays and compounds, s o t he v ariable that 
drives the separation is greater than the difference in results produced from different 
array types. 
Matrix analysis 

A matrix analysis compares each variable against every other in a graphical 
format. Figure 4 shows a matrix plot of the same data used in the PCA model. In 
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indicates natural logs. Sf = scaling factor, rawq = rawQ, bgavg = background average, 
gapdh = GAPDH 375' ratio, actin = actin 375' ratio, biob = BioB, percenpresent = 
percent present. 

RawQ and average background break the data into two clusters. This is most 
5 easily seen by following the rows and columns of those two variables. We present natural 
log s cales f or c onsistency with t he P CA m odel. The s ame c onclusions a re r eached o n 
linear scales. Figure 5 is a matrix plot on linear scales of the same data used in the PCA 
model, bgavg = background average, gapdh = GAPDH 375' ratio, actin = actin 375' 
ratio. 

10 Technical variability 

Histograms (Figure 6) of RawQ (gr rawq, hist bin(50) ylabel 
xlabel(0,5 to 80)) and background (gr bgavg, hist bin(50) ylabel 
xlabel(0,200 to 2000)) show that the data is bimodal 

Table 3. Comparison of reported versus deduced PMT 
15 settings. High PMT and Low PMT indicate the settings 



reported by operators. 



High PMT 



Low PMT 



RawQ < 7 



306 



RawQ > 7 



148 



55 



35 



EXPRESS MAIL LABEL: EV 187574229 US 
Docket Number: 3567.1 

The variability of RawQ is clearly associated with the PMT setting. In the 
instances where the PMT settings do not match the RawQ range (28 and 55), the settings 
are associated with 4 operators, so the PMT settings may have been reported erroneously 
in those cases. In all further calculations, the PMT setting was deduced from RawQ. 

BioB is an alternative measure that can be used to distinguish PMT settings. This 
measure depends on a pipetting step and can therefore be operator dependent. In the 
matrix graphs, it is evident that BioB breaks out the data into an additional group with 
very high BioB values. All the data points in this group belong to a single operator 
(Figure 8). 

It is possible to eliminate the contribution of PMT to the variance of the dataset 
by breaking the dataset up into two groups, one for each setting (Figure 9). 

Compound J 

To evaluate the effect of different users and quality measures on the interpretation 
of a biological response to a compound, compound J from the hepatotox study was 
analyzed. This compound was selected because it represented the largest set of arrays 
and the most variables for a single compound. 

Compound J 

Site 1 2 3 4 5 17 18 

Arrays 18 24 18 9 9 9 14 

The number of arrays each site used for Compound J. 
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Quality control of Compound J 

Statistical model 

The statistical model was built in two steps: 

K Stepl: ANOVA is highly sensitive to differences in variance by class. To 
avoid such an influence we used a weighted least squares method where 
weights are the standard deviation of each class. With this method each 
compound from each user were corrected for differences in variance 
between dose and time as follows: 



1) First calculate the standard deviation of all logsig_plus values (i.e. no 
distinction made for probesetlDs) for each dose at each time point. 

2) Next an ANOVA for all arrays treated with a given compound from a 
given user was performed. The model had this form: 

logsig_plus = dose + timepoint 

Dose and timepoint are treated as categorical variables as linear and 
nonlinear effects may be biologically important. 

Controls are dose = 0 

3) The residuals from this model were then captured and divided by the 
standard deviation for each dose time point group as appropriate. By 
using residuals the effect of difference is class means are removed. 
These new values are hereafter referred to as LOGSIG 2way STD to 



37 



EXPRESS MAIL LABEL: EV 187574229 US 
Docket Number: 3567.1 



denote that 2-way standardization has been applied. Two way refers to 
the two parameters dose and timepoint. 

S Step 2: For each probesetID an ANOVA model (For this model the null 
hypothesis is that no dose or time point is significantly different from any 
other. Rejecting the null and accepting the alternative hypothesis is 
interpreted as at least one time point or dose is significantly different from 
the others for this transcript) was tested on the 2-way standardized data: 

1) ANOVA model: 

logsig_2way_std = dose + timepoint 
Dose and timepoint are categorical variables. 
Controls are treated as dose = 0. 
Partial sums of square were used. 

2) The p values for the complete model and the partials dose and 
timepoint were captured. 
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Quality metrics derived from ANOVA 

A benefit of and ANOVA model is that it provides information of how well a 
transcript follows the model, in other words the biological effect, but it will also provide 
information on data that do not follow the model. Outliers for each probe set were 

5 derived from residuals from the ANOVA. Residuals are the differences between 
observed values (Signal) and expected values (mean). The numbers of residuals where 
the standard deviation is greater than 2 and greater than 3 are reported. The most 
significant quality control issue for Compound J is the PMT setting, which serves as a 
good illustration of this approach (Figure 10). 

10 This approach to give us an indication of all QC metrics (Figures 1 1 and 12). 

It is to be understood that the above description is intended to be illustrative and 
not restrictive. Many variations of the invention will be apparent to those of skill in the 
art upon reviewing the above description. The scope of the invention should be 
15 determined with reference to the appended claims, along with the full scope of 
equivalents to which such claims are entitled. All cited references, including patent and 
non-patent literature, are incorporated herewith by reference in their entireties for all 
purposes. 
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